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This paper introduces a class of linear programming examples 
which cause the simplex method to cycle indefinitely and which 
are the simplest possible examples showing this behaviour. The 
structure of examples from this class repeats after two iterations. 
Cycling is shown to occur for both the most negative reduced cost 
and steepest edge column selection criteria. In addition it is shown 
that the expand anti-cycling procedure of Gill et al. is not guar- 
anteed to prevent cycling. 
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1 Introduction 



Degeneracy in linear programming is of both theoretical and practical impor- 
tance. It occurs whenever one or more of the basic variables is at its bound. An 
iteration of the simplex method may then fail to improve the objective func- 
tion. The simple proof of finiteness of the simplex algorithm relies on a strict 
improvement in the objective function at each iteration and the fact that the 
simplex method visits only basic solutions, of which there is a finite number. 
However if the problem is degenerate there is the possibility of a consecutive 
sequence of iterations occurring with no change in the objective function and 
with the eventual return to a previously encountered basis. Examples such 
as Beale's [2] have been constructed to show that this can happen, though 
such examples do seem to be very rare in practice. A more common practi- 
cal situation is where a long but finite sequence of iterations occurs without 
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the objective function improving — a situation called stalling — and this can 
degrade the algorithm's performance. 

A related issue is the behaviour of the simplex algorithm in the presence of 
roundoff error. At a degenerate vertex there is a serious danger of selecting 
pivots that are small and have a high relative error. 

A wide range of methods have been suggested to avoid these problems. 

Lexicographic ordering: These methods are guaranteed to terminate in 
exact arithmetic but are often prohibitively expensive to implement for 
the revised simplex method and do not address the problem of inexact 
arithmetic. 

Primal-dual alternation: These methods were introduced by Balinski and 
Gomory [1] and have recently been developed by Fletcher [3,5,4]. Some of 
these methods guarantee to terminate in exact arithmetic and also exhibit 
good behaviour with inexact arithmetic. 
Constraint perturbation and feasible set enlargement: These methods 
attempt to reduce the likelyhood of cycling and also attempt to improve 
the numerical behaviour and reduce the number of iterations. The Devex 
and expand procedures described below are of this type. In addition it 
is claimed that stalling cannot occur with expand with exact arithmetic. 
Wolfe's method is a recursive perturbation method which guarantees termi- 
nation in exact arithmetic. 

In [10] Wolfe introduced a perturbation method which is guaranteed to termi- 
nate in a finite number of steps in exact arithmetic. In this method, whenever 
a degenerate vertex is encountered, the bounds producing the degeneracy are 
expanded in such a way that the current vertex is no longer degenerate. Other 
bounds on the basic variables are temporarily ignored. The simplex method 
works on this modified problem until an unbounded direction is found. If the 
bound expansion is random, it is highly unlikely that further degenerate ver- 
tices will be encountered before the unbounded direction is found. However if 
a further degenerate vertex is discovered, it is guaranteed to have fewer active 
constraints. The perturbation process is repeated and after a finite number of 
steps a non-degenerate vertex is reached with an unbounded direction. This 
direction is then used in the original problem to give an edge leading out of 
the degenerate vertex. It is not obvious how to extend this method to the case 
of inexact arithmetic, as there is then no obvious criterion for what constitutes 
a degenerate vertex. 

In [9] Harris introduced the Devex row selection method, which allowed small 
violations of the constraints and used the resulting flexibility to choose the 
largest pivot. This has the advantage of both avoiding unnecessarily small 
pivots and reducing the number of iterations. The disadvantage is that the 
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constraints are violated and some steps are negative. The variable leaving the 
basis does not normally do so at one of its bounds, but is shifted to that value, 
resulting in inconsistent values for the basic variables. The method attempts to 
correct this inconsistency at regular intervals (usually after each reinversion) 
by doing a reset, in which the basic variable values are recalculated from the 
values of the nonbasic variables. This can produce infeasible values for the 
basic variables (i.e. outside the specified tolerance) so there is no guarantee 
that progress has been made. However the method seems to be effective in 
practice in reducing the number of iterations taken, and variants of it are 
used in some commercial codes. 

Gill et al [7] developed the expand method in an attempt to improve on the 
good features of the Devex method of Harris and also to incorporate some fea- 
tures of Wolfe's method which guarantee finite termination. The performance 
of MINOS was significantly improved by the incorporation of expand. At each 
iteration of the expand method the bounds are expanded by a small amount. 
As in Devex, the largest pivot that does not lead to any constraint violation 
(beyond the current expanded position) is chosen. If the normal step for the 
largest pivot is sufficiently positive, it is taken; otherwise a small positive step 
is taken. In all cases the variable values stay within their expanded bounds. 
Because at every iteration the nonbasic variable is moved a positive amount 
in the direction that improves the objective function, the objective can never 
return to a previous value so no previous solution can recur. 

In this paper we introduce and analyse the simplest possible class of cycling 
examples, the 2/6-cycle class. In Section 2 we present an example of this class 
which cycles when using the most negative reduced cost column selection cri- 
terion. In Section 3 the general form of such examples is derived. In Section 
4 a variation of the example is introduced which cycles for the steepest-edge 
column selection rule. In Section 5 the behaviour of the expand procedure is 
analysed and a simple necessary and sufficient condition is derived for indefi- 
nite cycling to occur. 



2 Introductory example 

We first solve the four variable, two constraint problem (1) by the simplex 
method. The analysis later in the paper shows how to derive examples of this 
form. The problem is unbounded. A bounded example with identical behaviour 
can be obtained by adding the upper bound constraints x± < 1 and x 2 < 1, 
either as implicit upper bounds or with one or more explicit constraints. The 
variable to enter the basis will be chosen by the most negative reduced cost 
criterion and, where there is a tie for the variable to leave the basis, the variable 
in the row with the largest pivot will be chosen. 
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Max z = 2.3xi + 2.15^2 - 13.55x3 - 0.4x 4 , 

subject to 0.4xi + 0.2x 2 - 1.4x 3 - 0.2x 4 < 0, (1) 
-7.8xi - 1.4x 2 + 7.8x 3 + 0.4x 4 < 0, 

Xj >0, j = l. .A. 

After introducing slack variables x 5 and x 6 and writing the equations in de- 
tached coefficient form we get tableau All the variables are initially zero 
and will remain zero at every iteration. In the first iteration x\ is chosen to 
enter the basis. There is only one positive entry in the X\ column, so there 
is a unique pivot choice with x 5 leaving the basis. This basis change leads to 
tableau T^ 2 \ In the second iteration x 2 is chosen to enter the basis. In the 
normal ratio test there is a tie between xq and x\ to leave the basis. Breaking 
the tie by using the larger pivot (as is normal for numerical stability) gives xq 
to leave the basis, and the basis change yields tableau T^ 3 \ 



Xi 


%2 


^3 


x 4 


x 5 


x 6 


z 






0.4 


0.2 


-1.4 


-0.2 


1.0 






= 




-7.8 


-1.4 


7.8 


0.4 




1.0 




= 




-2.3 


-2.15 


13.55 


0.4 






1.0 


= 




1.0 


0.5 


-3.5 


-0.5 


2.5 






= 






2.5 


-19.5 


-3.5 


19.5 


1.0 




= 


y(2) 




-1.0 


5.5 


-0.75 


5.75 




1.0 


= 




1.0 




0.4 


0.2 


-1.4 


-0.2 




= 






1.0 


-7.8 


-1.4 


7.8 


0.4 




= 


T (3) 






-2.3 


-2.15 


13.55 


0.4 


1.0 


= 





Note that tableau is the same as tableau with the x variable columns 
shifted cyclically two columns to the right. It follows that this example will 
return to tableau after a further 4 iterations and therefore will cycle 
indefinitely with a cycle length of 6. In this example there are only two sets 
of coefficients: and are the same as with the x variable columns 
shifted cyclically 2 and 4 columns to the right, and and are the same 
as 

T (2) 

again shifted cyclically 2 and 4 columns to the right. We refer to such 
examples as 2/6-cycle examples. In this paper we restrict attention to 2/6- 
cycle examples as they are more elegant and easier to analyse than 6/6-cycle 
examples, such as Beale's example, which take 6 iterations to repeat the same 
coefficients. All the results here are demonstrated for 2/6-cycle examples. 
However the 2/6 property is not needed for the results and indeed 6/6-cycle 
examples can be formed by perturbing the 2/6-cycle examples given in this 
paper. 
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3 The form of 2/6-cycle examples 



The following analysis was used to construct the above example. Let the 3x6 
matrix be formed from the x columns of T^> as follows 



A B I 
a b 



where A, B and / are 2x2 blocks of the constraint rows and a, b and are 
1x2 blocks of the objective row. To be able to pivot on the (1,1) and (2,2) 
entries in iterations 1 and 2, we require A to be non-singular. These pivoting 
operations yield tableau T^ 3 \ whose submatrix formed from the x columns 
has the form 



I A V B A- 1 
b - aA~ l B -aA~ x 



For the constraint pattern to repeat after these two iterations we require A = 
A L B and B = A -1 , which occurs if and only if A 3 = I. This implies that the 
eigenvalues, A, of A satisfy 



A 3 



(A 2 + A+ 1)(A- 1) = 0. 



(2) 



For a 2 x 2 real matrix A there must either be 2 real eigenvalues or a complex 
conjugate pair. 

It follows from (2) that if A has real eigenvalues they must both have the value 
1, in which case the 2x2 matrix polynomial A 2 + A+I has two real eigenvalues 
of 3 and is therefore non-singular. Since (A — I)(A 2 + A + /) = A 3 — I = 0, it 
follows that A — I in this case. It is then easy to show that a = b = 0, which 
is of no interest as it corresponds to a zero cost row. 

The other possibility is that A has a complex conjugate pair of eigenvalues, 
and it follows from (2) that they must satisfy 



A + A + 1 = 0. 
The characteristic equation of a general 2x2 matrix A is 
A 2 - (A n + A 22 )X + (A U A 22 - A 21 A 12 ) = 0. 



(3) 



(4) 



Equations (3) and (4) hold for the two distinct values of A, so for a suitable 
2/6-cycle example we require An + A 22 = —1 and A\\A 22 — A 2 \A\ 2 = 1. From 
these it follows that 
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Table 1 

Coefficient values over two iterations for 2/6-cycle examples 







X'2 






^5 






/111 

^11 








x 




M« = 


A21 


-(An +1) 


-A21 


An 




1 




-1 




-(An +1)+M21 


-A12 - fiAn 








1 


A i2 
An 




A12 

An 


1 

An 




M( 2 ) = 




1 

An 


A 2 i 

An 


-( 1+ A^) 


A21 
An 


1 






^+ An 


M21 - (2 + An + ^-) 


-Ai 2 (l+ -/iAll 


1 

An 





(5) 



Conversely, any 2x2 matrix such that Au+A 22 = —I and (5) holds has char- 
acteristic equation (3). Since a matrix satisfies its own characteristic equation, 
A 2 + A + / = 0, from which it follows that A 3 = I. 

The objective function will repeat after 2 iterations if and only if b— aA~ l B = a 
and b = —aA~ l . This occurs if and only if a(A 2 + A + 1) =0, which holds for 
all a since A 2 + A + / = 0. There is therefore no restriction on a. Since the 
scaling of the objective row is arbitrary we take a to have the form 

a = [-1,(4, 

where there is no restriction on the value of \i. It follows that there is a three 
parameter family of 2/6-cycle examples: the parameters can be chosen as fi, 
An and Ai 2 . 

For arbitrary a, the vector b must satisfy 

b = -aA-\ (6) 
Since A is real and A 3 = J, det(^4) = 1. Hence 



B = A- 1 = 



-(An + 1) 
-A 2 i 



-A12 
An 



and b= [-(An + 1) + /iA 21 , -A 12 - /lAu], 

and follows that the general form of and for the 2/6-cycle examples 
with the pivot sequence fixed is as in Table 1. 

Proposition 1 summarises these results. 
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Proposition 1 Assume the cost row is nonzero and the 2/6-cycle pattern of 
pivots is selected. Then the necessary and sufficient conditions for the coeffi- 
cient pattern to repeat after two iterations are that the coefficients have the 
form given in tableau M^> of Table 1, and that An, A 21 and A 12 satisfy (5). 

We now deduce the inequality relations that must be satisfied for the simplex 
method to select (1,1) and (2,2) as pivot elements. In order for (1,1) to be a 
pivot in tableau we require 

A n > 0. (7) 

From (5) and (7) it follows that A 2 \ and A i2 are nonzero and have opposite 
signs. If A 2 \ is positive, A\ 2 and hence ^ are negative, so entry M^ 2 is 

(2) 

negative and M 22 is positive, which is just the situation in the numerical 
example shifted cyclically one column to the right and with rows 1 and 2 
interchanged. Hence without loss of generality we can take 

A 21 <0, (8) 
A 12 >0. (9) 

It follows that the first row has the only positive entry in column 1 of 
and both constraint row entries in column 2 of are positive. Hence row 
1 is the unique pivot candidate in iteration 1. There are two possible choices 
of pivot in column 2 of iteration 2. We shall use the largest pivot rule to break 
a tie. This rule chooses from the possible pivots the one of largest magnitude, 
and is the best choice from the point of view of numerical stability. To simplify 
the presentation we assume that if a tie remains after applying this rule, then 
the pivot in row 1 is chosen. This second tie-break rule therefore breaks the 
2/6-cycle pattern if the pivot size criterion does not determine the pivot row. 
It follows that row 2 is the pivot choice in column 2 of iteration 2 if and only 
if 

J- > <=► A 12 < 1. (10) 



in ^li 



We have therefore proved the following proposition. 

Proposition 2 // the conditions of Proposition 1 are met and row selection 
ties are resolved by choosing the largest pivot and the columns are selected in 
the 2/6-cycle order, then the necessary and sufficient conditions for row 1 to 
be selected in odd iterations and row 2 in even iterations are < An and 
< A 12 < 1. 

The conditions guaranteeing that column 1 is chosen in by the most 

negative reduced cost rule rather than column 2 or 3 are 
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-Kfi, (11) 
-1 < -(A n + 1) + fiA 21 ^ fi<^. (12) 

It follows from (7) and (8) that fi is negative. Column 1 is guaranteed to be 
chosen rather than column 4 if and only if 

1 - A 12 

-1 < -A 12 - fJ.Au fj < — , 

which is always true as this bound is positive by (7) and (10). 

In , column 5 has a positive cost entry so is not a candidate. The necessary 
and sufficient conditions for column 2 to be a candidate and be guaranteed to 
be chosen rather that columns 3 or 4 are 

f<"^. (13) 

I — ^21 

A 12 (l + ^-) 

»<-- ht 1 - < 15 > 

Comparing (13) and (15) we see that (13) is redundant if 
^12(1 + „ A 12 



< 



An + 1 An 
^ -A 12 A U - 2A 12 < -A U A 12 - A 12 -A 12 < 0, 

which is true by (9). Comparing (14) and (15), then using (8) and then (5), 
we see that (14) is redundant if 

A 2 (l + ^ 7 ) < (2 + A 11 + ^ + ^) 



An + 1 1 - A 2 i 

A 12 (A U + 2)(1 - A 21 ) > (An + l)(2A n + A n + 1 + A 12 ) 
A 12 (A n + 2 - A 21 (A n + 2) - A n - 1) > (A u + l) 3 
<^ -A 12 A 21 (An + 2) + A 12 > (An + I) 3 

(1 + An + A?!) (A n + 2) + A 12 > (A n + l) 3 
<^ (A n + l) 3 + 1 + A 12 > (A u + l) 3 <^ 1 + A 12 > 0, 

which (9) shows is true. Comparing (12) and (13), then using (8) and then 
(5), we see that (12) is redundant if 

_An < 4i ^ -A 12 A 21 > A 2 n A 2 U + A n + 1> A 2 n , 

A u A 2l 
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which (7) shows is true. 



We have now shown that (12), (13) and (14) are redundant, so (15) is always 
the tightest upper bound. From this and (11) it follows that \i must lie in the 
range 



, „ _ A n (A n + 2) 

- 1 < " < - A^+ry (16) 

and there is a positive gap between these bounds if and only if 



If the left hand inequality in (16) is reversed, then column 2 will be chosen 
rather than column 1 in , and if the right hand inequality is reversed, then 
column 4 will be chosen instead of column 2 in M^ 2 \ In either case the 2/6- 
cycle pattern will be broken. If either inequality in (16) holds as an equality, 
then the most negative reduced cost rule does not uniquely determine the 
column to enter the basis. To simplify presentation we assume that when this 
occurs a choice is made which breaks the 2/6-cycle pattern. 

We have now proved the following proposition. 

Proposition 3 Assume that the the most negative reduced cost column se- 
lection rule and the largest pivot row degeneracy tie breaking rule are used. 
Then a 4 variable 2 constraint degenerate LP problem will have the 2/6-cycle 
pattern and cycle indefinitely if and only if the conditions of Propositions 1 
and 2 hold and in addition (16) holds (which implies (17)). 

The unshaded area in Figure 1 (ignoring the dashed constraint) shows the 
region where the problem cycles indefinitely. Taking A n = 0.4, A 12 = 0.2 
and pi = —2.15/2.3 and then scaling the objective row by 2.3, produces the 
example given in Section 2. 

A similar analysis to that leading to Proposition 1 for the case of a 2/4-cycle 
example shows that the cost row must be zero, so such examples cannot cycle. 
It is also straightforward to show that there can be no cycling examples with 
all pivots in the same constraint row, so there can be no problems with a single 
constraint. In the 2/6-cycle examples A i2 and A 2 \ must have different signs, so 
it follows from Table 1 that the even and odd iterations cannot be the same. 
Hence the 2/6-cycle examples are the simplest possible cycling examples. 
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Fig. 1. Cycling region is unshaded. (Also cycles for expand if A\\ < ^) 
4 A cycling steepest-edge example 

In the previous sections the column was selected using the original Dantzig 
criterion of most negative reduced cost. In the steepest-edge method [8] the 
column is selected on the basis of the most negative ratio of the reduced cost 
to the length of the vector corresponding to a unit change in the nonbasic 
variable. This normally leads to a significant reduction in the number of itera- 
tions. When steepest-edge column selection is used on the example in Section 
2, column 2 is chosen in instead of column 1 and in the following iteration 
the problem is shown to be unbounded so the simplex method terminates in 
2 iterations. However by adding an extra row which affects the steepest-edge 
weights but not the choice of pivot row, one can construct a steepest-edge 
cycling example. 

To preserve the 2/6-cycle pattern of the example, any extra constraints must 
behave like the objective row in that they must satisfy (6). We shall now 
construct an example that has a single candidate column in column 2 of T^ 2 \ 
We do this by selecting /i so that the x A objective coefficient in is zero. 
It follows from Table 1 that the required value is /i — —1.75, and this results 
in the tableaux shown in Table 2, omitting the third rows. Note that column 
1 would not now be selected in either by the most negative reduced cost 
criterion or by the steepest-edge criterion. We now introduce a constraint 
that will leave the steepest-edge weight of column 1 of unaltered but 
increase the weight of column 2. If the entries in this constraint are scaled up 
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Table 2 

Cycling example with steepest-edge column selection 



Xl 


X2 


%3 


X4 


X5 




x 7 


I 








0.4 


0.2 


-1.4 


-0.2 


1.0 








= 







-7.8 


-1.4 


7.8 


0.4 




1.0 






= 







0.0 


-20.0 


156.0 


8.0 






1.0 




= 


1 




-1.0 


-1.75 


12.25 


0.5 








1.0 


= 







1.0 


0.5 


-3.5 


-0.5 


2.5 








= 









2.5 


-19.5 


-3.5 


19.5 


1.0 






= 





r (2) 




-20.0 


156.0 


8.0 


0.0 




1.0 






1 






-1.25 


8.75 


0.0 


2.5 






1.0 









1.0 




0.4 


0.2 


-1.4 


-0.2 















1.0 


-7.8 


-1.4 


7.8 


0.4 











T (3) 






0.0 


-20.0 


156.0 


8.0 


1.0 






1 








-1.0 


-1.75 


12.25 


0.5 




1.0 










sufficiently, we can make steepest-edge choose column 1. Using a = [0, —20.0] 
and applying (6) we get the third row of tableau We set the right-hand 
side of this constraint to 1, which ensures that this constraint is not involved 
in any of the pivot choices even when the matrix coefficients are perturbed by 
a small amount. With this extra row added the steepest-edge reduced costs for 
columns 1 and 2 of are —0.127 and —0.087, which leads to the selection 
of column 1 as required. 



5 Analysis of the expand procedure 

The analysis given by Gill et al [7] of their expand procedure proves that the 
objective function can never return to a value it had at a previous iteration. 
The expand procedure however relaxes the constraints at each iteration, so 
the fact that the objective function continually improves does not prove that 
the method will not return to a previous basic solution. In Section 5.1 we 
describe the expand procedure and in Section 5.2 derive the necessary and 
sufficient condition for cycling still to occur with the 2/6-cycle examples when 
using EXPAND. We do this by deriving an expression for the values of ev- 
ery variable at every iteration, a task that is made tractable by the special 
structure of the 2/6-cycle examples. 
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5. 1 The expand ratio test 



The expand approach to resolving degeneracy is described by Gill et al in [7] 
for the general bounded LP problem. The examples in this paper have single 
sided bounds and are of the form 

minimize c T x 

subject to Mx = b, x > 0. 

For simplicity, expand is discussed here for this problem. Assuming that all 
the variables are feasible (x > 0), the standard ratio test for the simplex 
method determines the maximum step a in the direction p corresponding to 
the pivotal column such that the variables remain feasible, that is x — ap > 0. 
For each j, the step which zeroes Xj is etj = Xj/pj if pj > 0, otherwise otj = oo. 
The maximum feasible step is therefore a = a r = min, otj and the variable to 
leave the basis is x r . 

expand is based on the use of an increasing primal feasibility tolerance 5. 
During a particular 'current' simplex iteration, this tolerance has the value 
5 = 5+t, where 5 was the value of 5 in the previous iteration. At the beginning 
of the current iteration each variable satisfies its expanded bound Xj > —5. 
Since —5 < —5, it is always possible to ensure that a > 0, so there is a strict 
decrease in the objective function. 

The expand ratio test makes two passes through the entries in the pivotal 
column p. 

- The first pass determines the maximum acceptable step a max > so that 
each basic variable satisfies its new expanded bound Xj > —5. 

- The second pass determines a variable x r to leave the basis. x r is the variable 
with the largest acceptable pivot and is defined by 

r = argmaxp, such that «,■ < a max where a,- = < Xj '^ j ^] ^ ® . 

j J J J y a j — oo otherwise. 

Define a fu11 = a r . This is the step necessary to zero x r . Note that if x r < 
and p r > then a fu11 will be negative. 

- A minimum acceptable step 

Pr 

is calculated. If x r = —5 then this is the maximum step that can be taken 
whilst maintaining feasibility with respect to the new expanded bounds. 

- The actual step returned by the expand ratio test is 

a = max(« min , « fu11 ). 
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We refer to these two alternative step sizes as the min and the full step. 



The initial values of the nonbasic variables are zero. In the 2/6-cycle exam- 
ples the initial values of the basic variables are also zero. The initial value of 
the expanding feasibility tolerance is denoted by ru, where u > 0, and the 
tolerance during iteration n is denoted by ru n . It follows that u n = u + n. 



5.2 Conditions under which cycling occurs with the expand ratio test 



In this section we analyse the behaviour of the 2/6-cycle problems when using 
the expand ratio test and derive necessary and sufficient conditions for the 
2/6-cycle problems to cycle indefinitely. 

The action of the expand ratio test depends on whether the iteration number 
is even or odd, so we consider separately the behaviour in iterations n = 2k + 1 
and n = 2k + 2 for k > 0. We assume that the pivot columns are selected in the 
2/6-cycle order and derive necessary and sufficient conditions for expand to 
select a pivot in the first row in odd iterations and have a unique pivot in the 
second row in even iterations. We also show that the min step is taken when 
the pivot is in row 1 and the full step is taken when the pivot is in row 2. 

Let x™ denote the value of Xj at the start of iteration n. The subscripts of x 
are calculated modulo 6. 

For iteration 2k + 1 the pivotal column is [An A 2 \ ] and the values of the 
basic variables at the start of the iteration are respectively a^fc-i an d %lk +1 - 
Since A 2 \ < and An > 0, only x 2 k~i moves towards its bound, so it is the 
sole candidate to leave the basis. The second pass of the expand ratio test 
returns 



a 



full 



x 2k-l 



and if 



xT-l < r, (18) 
the min step will be taken so 



T 

a = — 



It follows that if (18) holds, the changes in variable values are as given in row 
1 of Table 3. 
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For iteration 2k + 2 the pivotal column is [A 12 /Au l/An] T and the values 
of the basic variables at the start of the iteration are respectively a^fc+i an< ^ 
x ik +2 - Since An > and A\ 2 > 0, both variables move towards their bound. 
The first pass of the expand ratio test returns 



a™ = mm 2k+l 



A 12 /A u 1/Au J 

A sufficient condition for the pivot to be in row 2 is that A\ 2 < 1 and that 
the pivot is acceptable. It is acceptable if and only if 



x 



2k+2 
2k 



1/An 

/ 2fe+2 , 2fc+2 \ 

<=► A u xT 2 < A u min , 4t +2 + ™ 2fe+2 J . 

Clearly x 2 ^ 2 < xll +1 + ru 2k+2 , so the pivot in row 2 is acceptable if and only 
if 

A 12 x 2k+2 <x 2k X\ + TU 2k + 2 . (19) 

Also, provided that 

x 2k+2 > r (20) 

then a fu11 = A n x 2 2 k k +2 > a min = A u t, so the full step a fu11 is taken and the 
EXPAND ratio test returns 

a = A u x 2 2 k k +2 . 

Hence if (19) and (20) hold, then the changes in values are as given in row 2 
of Table 3. 

From the changes in the values of variables given in Table 3, the expressions in 
Table 4 for the values of each variable over any two iterations are established by 
induction. To simplify notation we introduce the quantities Sk and Sk defined 
by 

k k 

Sk = Yl Ai, S k = J> + 1 - *)Ai, f o r ah k > 0, 

i=0 i=0 

Sk = 0, Sk — 0, for all k < 0. 

Note that since An > 0, Sk and Sk are nonnegative. Also 

S k - S k ~i = s k , for all k, 
s k = 1 + AnSk-u for all k > 0. (21) 
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Table 3. Changes in values of variables over two iterations 



n 




Entering 


Leaving 




Remaining 


Step 


2k + 1 
2k + 2 


J2k+2 
x 2k+l 

™2fc+3 
x 2k+2 


_ 2k+l , T 

— x 2k+l T A 

_ 2k+2 A 

— x 2k /in 


™2fc+2 _ 2k+l 
x 2k-l — x 2k~l ' 

4t +3 = o 


™2fc+2 
x 2k 

™2fc+3 
x 2fc+l 


_ T 2k+1 T A 21 

— X 2k T A 

Al.1 

_ J2k+2 J2k+2 a 

— X 2k+1 X 2k /li2 


Pivot row 1. Min step 
Pivot row 2. Full step 



k k 

Table 4. Expressions for the values of each variable over any two iterations. Sk = ^ A l u , Sk = + 1 — 

i=0 i=0 



n 


X 2k + 1 


■ L 2k+2 


X 2fc + 3 


X 2fc+4 


■ L 2k+5 


x 2fc+6 


Expanded 


Normal 




-rS fc _ 2 





-rSk-i 





r(l - S fc ) 


-rA 2 is fe _i 






2fc + l 


An 


A12 


-(An + 1) 


-A12 


1 





t(1 - S fc + w 2 fc+i)-r— 
An 


T(l-Sfc)-^- 

An 




A 2 i 
T 


-(A n + 1) 


-A21 


An 





1 


00 


00 




T (~T 

An 





—TSk-l 







A21 

— T Su 

An 






2fc + 2 


1 


A12 

An 


An 


A12 
An 


1 

aT7 





' r (-T Sfc-2 +«2fc+2)4^" 

An A12 


T( l Sk - 2 '~T~ 

An A12 







1 

aT7 

t 


A21 
An 




A21 
An 


1 


^(-4^" s fc +«2fc+2)All 
An 


-rA2iSfc 




r(l-S fc+ i) 


-rA2\s k 


-r5 fc _i 





-rS k 










The expressions in Table 4 allow condition (19) to be expressed as G k > 0, 
where G k for k > is defined by 

A 12 A 21 1 2fc+2 

<^fc — "j Sfc + -j + M 

-All An 

A necessary and sufficient condition on A n for Gk > is established by 
considering 

AG k = Gfc+i — G k 

= ^^{s k+1 - s k ) - (S fc _i - S k _ 2 ) + - 



4 11 
An 

= -(s fc _x + A k n + + A k + 2 ) + 2 

= -Sfe+2 + 2. 

It follows that AG k > <^=^> Sfe +2 < 2. If < A u < |, then s k+2 increases 
to a limit s^, where < 2. In this case AG k > for all k so G^+i > G k for 
all k, and also Go > u + | > 0, so G k > for all k > 0. If An > |, then there 
exists an e and X such that 5^+2 > 2 + e for all A; > K. It follows that for 
suitably large k, G k < 0. Hence for positive An the necessary and sufficient 
conditions for G k to be nonnegative for all k is that A n < \. 

Proposition 4 Assume that the conditions of Proposition 1 are met and the 
EXPAND row selection method is used and the columns are selected in the 2/6- 
cycle order. Then necessary and sufficient conditions for cycling to occur are 
that < An < \ and < A 12 < 1. 

Proof: 



Sufficient conditions: 



We show by induction that the values of the variables at the start of odd 
iterations are as given in Table 4 and that these values lead to the correct 
choice of pivot row for the 2/6-cycle pattern. 

Initially all the variables have the value zero, so x 1 - = 0. Hence the values in 
Table 4 are correct for n = 1. Assume now that for some k the values in Table 
4 are correct at the start of iteration 2k + 1. 

In iteration 2k + 1, since s k is non-negative, x\\_ x < r, so (18) holds and it 
follows that the changes in the values of variables are as given by row 1 of 
Table 1. From this and (21) we get 

^Xl = -rA 2l s k ^-r^- (22) 
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= -T^(AnSk-i + 1) 

Mi 

= -T — S k . 

All the other values are straightforward, so we have deduced the values given 
in Table 4 at the start of iteration 2k + 2. 

Substituting these values into (19) we see that the pivot in row 2 is acceptable 
if and only if 

^12^21 1 „ ok+2 

' Sfe S -j <Jfc-2 + U , 



A u A n 
which is true provided An < \- Also 



2fc ^iife 11 " A n A 12 



since A n > (7) and A 12 < 1. Hence (20) holds, so the changes in the values 
of variables are as given in row 2 of Table 3. The new value for x 2 k+i is given 
by 

2k+3 ( 1 C i M2A21 \ 

= r [- A S k-2 - "j— Sfe - Sfc - AnSjfc J 

(^ h Sfe-i) - Sfc - (sfe+i - 1)) 



1 9 1 



= r(l - 5 fc+ i), 

which is the value given in Table 4. All the other values at the start of iteration 
2k + 3 follow straightforwardly and are as shown in Table 4. These values are 
the values in Table 4 for k, with the k replaced by k + 1. This completes the 
induction and shows that the 2/6-cycle pattern continues indefinitely. 



Necessary conditions: 

As discussed in Section 3, An > and we can choose A 12 > 0, in which case 
A 21 < 0. Since x\ = 0, the first iteration takes the min step and so x\ = r/A u - 
The pivot in row 1 in iteration 2 is acceptable if 

r An < amax 



A n A 12 

r . tA 21 



<-—^ + r (u + 2) 



L12 ^11 
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1 < — + 1 + A u + u + 2, 
An 



(23) 



which is true. Hence if A\ 2 > 1, the pivot will be in row 1 in iteration 2 and 
the 2/6-cycle pattern will be broken. If An > |, then the argument prior to 
Proposition 4 shows there is a first value of k, K say, such that < 0. 
As shown above, for all k < K the 2/6-cycle pattern is maintained and the 
variable values are as in Table 4. Therefore in iteration 2K the pivot in row 
2 is not acceptable, so the pivot must be in row 1. This breaks the 2/6-cycle 
pattern. □ 



The conditions derived in Section 3 for the minimum reduced cost criterion to 
choose pivot columns in the 2/6-cycle pattern relied on the conditions An > 
and < A12 < 1. These conditions have been established in Proposition 4 for 
the case of expand row selection, so it follows that (16) and (17) still hold. 
From (17) and the fact that A n < \ it follows that A 12 < ^, which is tighter 
that A 12 < 1, which is therefore redundant. We have now shown the following 
proposition. 

Proposition 5 A 4 variable 2 constraint degenerate LP problem will have the 
2/6-cycle pattern and cycle indefinitely when using the most negative reduced 
cost column selection rule and the expand row selection rule if and only if 
the conditions of Proposition 1 hold and in addition < An < \, < A 12 
and (16) holds (which implies relation (17)). 

The shaded area in Figure 1 including the A n < \ constraint is the region 
where cycling occurs when using expand. Note that the constraint A 12 < 1 
is now redundant. Also note that in the example (1), An = 0.4 < 0.5, so that 
example also cycles with expand. 

Finally note that the only way that expand can escape from the 2/6-cycle 
pattern is for it to select the first row as pivot row in an even iteration, and if 
this occurs the resulting tableau has the form 

Xi X 2 £3 £4 £5 Xq 



All 1 
An 1 

-AT* 



An 

An 



1 

A12 



A21 I 1 I 1 
An A12 ~ A11A12 



at 



A21 

Aii 



A11A12 



The constraint entries in the third and fourth columns are all negative and 
the objective function coefficients in all except these columns are nonnegative. 
Since the problem is unbounded we cannot be at an optimum, so one of these 
columns must be chosen. The next iteration will then produce an unbounded 
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step and the method will terminate. 

The above results are independent of the expand parameters u and r. In [7] 
it is suggested that the initial tolerance ru be taken to be half of the feasibility 
tolerance 8{ to which the problem is to be solved. The value of r is chosen so 
that after a large number of iterations (typically K = 10000) the expanded 
tolerance approaches <5f, at which stage 5 is reset to its original value <5;. If this 
is done with the 2/6-cycle examples after an even iteration, then the problem 
returns to its initial state. If it is done after an odd iteration then it returns 
to the even iteration case but with the values all zero. It can be shown that in 
this case too the problem cycles, so that in neither case does resetting break 
the cycle pattern. 



6 Conclusions 

We have derived a three-parameter class of linear programming examples 
which cause the simplex method to cycle indefinitely. When written in stan- 
dard form, these examples have two constraints and 6 variables and the co- 
efficient pattern repeats every two iterations. These are the simplest possible 
examples for which the simplex algorithm cycles. We have derived 4 inequal- 
ities between the parameters and shown that these are the necessary and 
sufficient conditions for members of this class to cycle with Dantzig's form of 
the simplex method. We have shown how to extend the examples so that they 
also cycle when the steepest-edge column selection criterion is used. By adding 
the single bound, An < |, we were able to characterise the examples that also 
cycle using the expand row-selection mechanism. This shows that despite the 
fact that in the expand method the objective function is guaranteed to im- 
prove each iteration, the method is not guaranteed to prevent cycling. The 
cycling behaviour is independent of the expand tolerance parameters. The 
bound An < \ is the only extra condition that had to be applied to ensure 
that an example which would cycle under the usual Dantzig rule, with largest 
pivot as the tie-breaker, would also cycle using expand. This extra bound 
does reduce somewhat the number of cases that cycle, but does not eliminate 
the problem. Also the reduction is for problems where the degeneracy is exact. 
For problems which are close to degenerate expand may cycle whereas the 
original simplex method in exact arithmetic will not. 

All the coefficients in the examples (not just the 3 parameters) may be per- 
turbed simultaneously by any small amount without destroying the cycling 
behaviour. The 2/6-cycle examples are therefore just points in a full dimen- 
sional set of counter-examples, so there is a positive probability of encountering 
cycling in randomly generated degenerate examples. In practice therefore the 
expand procedure cannot be relied upon to prevent cycling. Provided we stay 
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within the class of the degenerate problems (i.e. keep the right-hand side 0) 
it is possible to vary the other coefficients by a significant amount. Indeed 
we have constructed examples where the values are totally different every 2 
iterations and yet indefinite cycling still occurs with expand. 

The examples have been tested on our own implementation of expand and 
using MINOS 5.4, which was written by the authors of expand. In both cases 
if no preprocessing is done the examples cycle indefinitely. MINOS periodically 
does a reset operation (by default after 10000 iterations). This returns the 
problem to its initial state so cycling is still indefinite. 

OSL [6] uses some techniques from expand. In the examples in this paper, 
OSL 2.0 without scaling or preprocessing and with Dantzig pricing cycles for 
30 iterations before reporting doing a perturbation, but it then continues to 
cycle indefinitely, cplex 4.0.7 without scaling or preprocessing cycles for 400 
iterations before resolving the degeneracy by introducing a large perturbation. 
XPressMP 7.14 without scaling and with an even invert frequency cycles in- 
definitely. However the bqpd code of Fletcher [4] detects degeneracy at the 
start of the first iteration, changes to the dual, does one pivot, then finds that 
the dual is infeasible. This gives an improving direction in the primal, which 
resolves the degeneracy. Finally, bqpd detect unboundedness in this direction 
and terminates, having done one pivot in total. 
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